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Abstract. On restriction to the maximal compact subgroup GL(3,K), an 
unramified principal series representation of the p-adic group GL(3, F) de- 
composes into a direct sum of finite-dimensional irreducibles each appearing 
with finite multiplicity. We describe a coarser decomposition into compo- 
nents which, although reducible in general, capture the equivalences be- 
tween the irreducible constituents. 



1. Introduction 

The aim of this paper is to investigate the relationship between the repre- 
sentation theory of a p-adic group G and its maximal compact subgroups K. 
Given an admissible representation of G, its restriction to K decomposes as 
a direct sum of smooth irreducible representations of K each with finite mul- 
tiplicity. The problem of describing this decomposition when G = GL(2, F) 
and K = GL(2, Jl), for F a non-archimedean local field of odd residual charac- 
teristic and its ring of integers 01, was extensively studied by Silberger [8] and 
Casselman [3] with the restriction on the characteristic removed. Further, the 
case of the principal series representations for G = SL(2, F) was considered by 
the second author in [6]. 

We are interested in G = GL(3, F) and its unramified principal series repre- 
sentations; the ramified case will be treated in a separate paper. The restriction 
to K = GL(3, "Jl) of any unramified principal series representation is simply the 
permutation representation over the subgroup B of upper triangular matrices 
in K. In particular, this contains the pull-back of the corresponding permuta- 
tion representation for the group GL(3, f), defined over the residue field f of F, 
and the decomposition of this is well known [9]: each irreducible constituent 
can be expressed as an alternating sum of permutation representations over 
certain standard parabolic subgroups in GL(3, f). 

Our approach is generalise this by considering representations Vc, indexed 
by triples c = (ci, C2, C3) with < ci, C2 < C3 < ci + C2, which are expressible in 
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terms of permutation representations over compact open subgroups containing 
B. By determining the double coset structure of K we are able to calculate 
the intertwining number J(Vc,Vd) for any two such components; that is, the 
dimension of the space of iiT-homomorphisms between Vc and Va.. Although 
is irreducible when 03 = 01+ 02 or maxjci, 02} , we find that it is reducible in 
general with J(Vc,K) depending on the order of the residue field. However, 
it transpires that two components are either completely equivalent or contain 
no common constituents. In the final section, we present an application of our 
results to a family of virtual representations defined by Lees [5] as analogues 
of the Steinberg representation. 



2. Principal series representations 

Let be a non-archimedean local field with ring of integers Ji and residue 
field f. We will assume that f has odd characteristic and order q. If tt denotes 
a conductor of F then the maximal ideal of 31 is CP = nOl. For each positive 
integer n G we define CP" = {.x € -F : val(.x) > n} where val is the discrete 
valuation on F normalised so that val(7r) = 1. 

Let G = GL(3), then G{F) = GL(3, F) is a locally compact group with 
maximal compact open subgroup K = G(3?) = GL(3, 3?). Indeed, the topology 
on G{F) has a neighbourhood base about the identity given by the compact 
open subgroups Kn = 1 + M^^^CJ''"') for n G Z_|_. Further, let B be the subgroup 
of upper triangular matrices and recall that B decomposes as B = TU where T is 
the subgroup of diagonal matrices and U is the subgroup of upper unitriangular 
matrices. We wiU denote by B, T and U the subgroups B(ai), T{Oi) and 
of K respectively. 

Given a character x of T{F) we may extend it to a character of M{F), again 
denoted X) by defining it to be trivial on V{F). The corresponding principal 
series representation of G{F) is the induced representation Indg^^j* x consisting 
of the space smooth functions 

V = {fe C°°(G(F)) : f{bg) = x{b)\b\fi9) for all g G G{F),be B(F)} 

with the action of G{F) given by right translation. The normalization factor |5| 
is introduced to ensure that Ind^^^j* x — x' whenever x and x' lis in the 

same orbit under the Weyl group W of G (see [2]*Theorem 3.3, for example). 

Wc will be interested in the restriction of the principal series representation 
V to the maximal compact subgroup K. As G(F) = KM{F) and B = M{F)nK, 
Mackey theory implies that 

ResJ^^V-Indf ResJ^^^ X- 

This can be interpreted as the principal scries representation of K obtained 
from the character Res^*-^^ x of T. The first step towards decomposing the 
restriction into irreducibles is the following result regarding the principal con- 
gruence subgroups Kn of K. 
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Lemma 2.1. The subspaces V^" of vectors fixed under the action of Kn are K- 
stable and finite- dimensional. They are non-zero if and only if KnClT C ker(x), 
in which case x extends trivially to a character of BK^ and 

where both sides are viewed as K -representations. 

In this paper we will be concerned the unramified principal scries; that is, 
the case where the restriction of x to T is the trivial character 1. Here we 
obtain the permutation representation 



and for each ra G Z 



+ 



Res^^^^ V ~ Indf 1 

= Indf;,„ 1. 
3. A DECOMPOSITION 

The filtration of K by congruence subgroups allows us to decompose the 
representation V into a direct sum of finite-dimensional K-invariant subspaces 

oo 
n=0 

However, these quotients are far from being irreducible in general so we will 
consider a finer filtration of K obtained from certain compact open subgroups 

Define the partially ordered set 

T = {c = (ci, C2, C3) G : < ci, C2 < C3 < ci + C2} 

with order given by c >r d if and only ii Ci> di for each i. We associate to each 
triple c = (ci, C2, C3) G T a compact open subgroup Cc of K by defining 

Cc = 01 01 nK 

rpC3 yC2 Jl 



and note that Cc C Cd if and only if c ^ d. Consequently, if for each c G T we 
set 

Uc = Indg'^ 1 

then arises as a subrepresentation of Uc precisely when d :^ c. Thus we can 
consider the quotient 

In particular, since BKn = C^n,n,n)i see that 

Our aim is to determine the reducibility of and equivalences between the 
Fc- To achieve this we first give a description of Vc as an alternating sum in 
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the Grothendieck group 'Xq(K) of K. Recall that 3Cq{K) is the abelian group 
generated by the isomorphism classes [V] of finitely-generated representations 
V oiK together with the relations [V(BU] = [V] + [U] and [V/U] = [V] - [U]. 

We begin with some notation. Let c = (ci, 02,03) G T and, if ci and C2 are 
both non-zero, for each 1 < z < 3 define 

= (Cl - C2 - 5i,2, C3 - Si^s) 

where Sij = 1 ii i = j and otherwise. If ci = then c = (0, 02,02) and we 
only consider C|3}. = (0, C2 — 1, C2 — 1). Similarly, if C2 = then we only have 
C{3}. = (ci — 1, 0, Cl — 1). The set of all triples in T lying immediately below c 
is then {c^jj. : i € Sc} where Sc = {i ■ Cjjj G T}. In particular, this means that 

Further, let C0 = c and for each non-empty I Q Sc define 
c/ = max{d G T : d ^ c^^y for all i G /}. 
For example, if c = (2,3,4) then C{i 2} = (1,2,3) since (1,2,4) ^ T. 
Lemma 3.1. For each I,JQSc we have Ucj n Ucj = ^^c/uj- 
Lemma 3.2. For any c G T with Sc = {1, 2, 3} 

(f/c{i} + Uc^,^) n Uc^,^ = Uc^,,,^ + Uc^,,,y 

Proof. This follows from [l]*Lemma 13 since Cc^^yCc^^y = Cc^^yCc^^y = Cc^^^y 
for each i. □ 

Proposition 3.3. For any c G T 

[K] =^ (-1)1^1 [t/,,]. 

ICSc 

Proof. First note that if Sc = {i} then Vc = Uc/Ua so clearly 

[Vc] = [Uc]-[Uc,,,]. 

Further, if S^ = {i,j} then J/c^.j + i/c^ = X © J/c^^ where X = Uc^.y/{Uc^^^ n 
Uc^.y) and ?7c^,j n Ucyy = Uc^^.y This gives [C/e^^j + i/cy^] = Pc^^] + Pc^.y] - 
[Uc{i^j}\ and Vc = Uc/{Uc^^y + C^c{,}) implies that 

[Fc] = [f/c]-[^C{,j]-[C/c,,5] + [f/c^„,,]. 
Finally, if = {1, 2, 3} then Uc^^y + t^cja} + ^c{,} = X © t^c{3} where on this 
occasion X = {Uc^^^ + ^c{2})/((^c{i} + ^c{2}) ^ ^c{3})- From Lemma 3.2 we 
know that (f^c|i} + Uc^2})^ ^^{n} ~ 3} ~'~ ^'^{2 3} using the same argument 
as before we see that 

Hence, K = Uc/iUc^^ + i7c{2} + ^0^3}) gives 

[Vo] = [Uc] - [Uc^,,] - [Uc^,,] - [C/c,3>] + [Uci,,,y] + [C/c,,,3>] + [t/c,,,3}] ' [Uc^,,,,,y] 
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as required. □ 
The space of Ki -fixed vectors in V 

is the pull-back to K of the permutation representation Ind^^^^^ 1 so its decom- 
position into irreducibles is well known. Specifically, 

V^' = ^(0,0,0) ffi ^(0,1,1) e F(i 

,0,1) ® ^(1,1,1) 

where [V(o,o,o)] = [^(o,o,o)] is the trivial representation; [V(o,i,i)] = [^^(o,i,i)] - 
[^(0,0,0)] 8.nd [V(i 0,1)] = [^(1.0,1)] ~ [^(0,0,0)] the equivalent irreducible con- 
stituents; and [V(i_i,i)] = [?7(Li,i)] - [t^(o,i,i)] - [f^(i,o,i)] + [f^(o,o,o)] corresponds 
to the Steinberg representation which is irreducible with multiplicity 1. 

More generally, we can use Proposition 3.3 to calculate the intertwining 
number between two quotients and as an alternating sum involving the 
intertwining numbers between various and Ua 

icSc, JcSi 

However, since Uqj and U^j arc the permutation representations on Ccj and 
Cdj respectively, we have J(J7c/, Udj) = \Ccj\K/Caj\, the number of {Ccj, Cdj)- 
double cosets in K. Thus we obtain the following. 

Corollary 3.4. Let c,d G T, then 

Xv.,v,)= J2 (-i)i'i+i^i|t^c,Wc<i,|. 

ICS,, JCSi 

Finally, we note that Proposition 3.3 also allows us to determine the dimen- 
sions of the Vc for c € T with C3 > 1. If we let |c| = ci + C2 + C3 then 

\ {q +Q + if ci = or C2 = 

so, writing C3 = Ci + C2 — k for some < A; < min{ci, C2}, we have 

+ + 5 + 1)^1=1-4 ifA; = 0; 

(q - l)iq - 2){q + l){q^ + q + l)q\^\-^ if A; = 1; 
(g - lf{q + l){q^ + q+ l)q\^\-^ if 1< fc < min{ci, C2}; 

(g - l)2(g + l)(g2 + g + l)gl=l-5 if = min{ci,C2}. 



dimFc 



4. (B,B)-DOUBLE COSETS 

It is clear from Corollary 3.4 that we need to describe the (Cc, Cd) -double 
coset structure of K. However, before tackling the general case we examine the 
double cosets of K with respect to the subgroup B of upper triangular matrices. 
These, and indeed the double cosets in the case where c = (c, c, c) = d, have 
recently been described by Onn, Prasad and Vaserstein [7]. 

Let W = {1, si, S2, S1S2, S2Si,wo} denote the group of permutation matrices 
in K where Sj corresponds to the transposition {i i + and wq is the element 
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of maximal length. From the Bruhat decomposition of GL(3, f) we can choose 
our {B, B)-doubIe coset representatives to be of the form wk for some w eW 
and k G Ki. If we let U~ denote the subgroup of lower unitriangular matrices 
in K, then the decomposition Ki = {Ki n U~){K n B) means that we may 
take k e Kif] U~. Further, we have U~ = V^Vw where 



and 



Vw = {[hj] e U : kij = if w{i) < w{j)} 
Vw = {[kij] e U- : kij = if w{i) > w{j)} . 



Thus, writing k = kik2 with ki € , /c2 S Vw wc see that BwkB = Bwk2B 
since wkiw^^ G U. We have therefore obtained the following special case of 
[4]*Proposition 2.6. 

Lemma 4.1. Every {B, B)-double coset representative in K can he chosen of 
the form wk for some w eW and k 

While Lemma 4.1 shows that there is exactly one double coset corresponding 
to wq, it does not give any information about the double cosets lying in the 
Iwahori subgroup BKi. Let = Z_|_ U {oo} with the convention that a < oo 
and oo + a = oo — a = oofor every a £ Z+. Define the set of triples 

3 

T°° = {(ai, 02, as) € : oi, 02 < 03} 
and for each a G T°°, x E Ji^ consider the element 





1 







7r"i 1 







7r"3x 7r"2 


1 



where we take 7r°° = and so set val(O) = 00. In the following we identify 3^/9* 
with a set of representatives in 3? chosen so that they contain the representatives 
corresponding to ^R/y^ for each j < i. 

Proposition 4.2. A complete set of {B,B)-double coset representatives in 
BKi is 



{t,,^:aGT°°,xGX^} 



where 



{1} 

(^I'ym\n{ai,a2,a3-ai,ai-a2}^^ ^ 

U~o(l + ^'^'') n (3l/ymm{ai,a2}+i)X 



if as = 00; 

if oi + 02 7^ 03 and 03 < 00; 
*/ oi + 02 = 03 and 03 < 00. 



Proof. From Lemma 4.1 we can choose our representative t = [tij] to lie in 
Ki n U~ . Indeed, since left and right multiplication by elements of B allows us 
to add multiples of t^i to t2i and t32 , we may assume that the lower triangular 
entries oft are such that max{val(t2i), val(t32)} < val(t3i). Further, conjugating 
by elements of T enables us to independently scale t2i and t32 by elements of 
01^ . We therefore obtain a representative of the form ta,a; for some a G T°° and 
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To show that different triples from T'^ correspond to different double cosets 
suppose that g = [gij] and g' = [g'j^j] are elements of B with gtg^^x = th,yg' for 
some a, b G T°° and x,y eJl^. The lower triangular entries give the equations 

T^^'^xgss = TT^^yg'n. 

The third equation clearly implies that 03 = 63 while the first equation gives 
ai < bi with ai = bi whenever ai 7^ 03. However, if ai = 03 then 63 > 5i > 
ai = = 63 and again 61 = oi. Similarly, 02 = 62 from the second equation 
so a = b. 

We now fix an a G T°° and address the admissible range of values for x. If 
03 = cxD then 7r"3 = and it is clear that we may take = {1} so we will 
assume that 03 < 00. Let x,y e Jl^ and suppose that we are able to choose 
elements ffii, ^22, 533 G 3?^ and 512,513,523 G 3^ in such a way that the following 
three equations hold: 

(1) 511 = 522 -vr"i 512 -7r"^T5i3+7r''3 -"1x523 

(2) 533 = 522 -vr"i5i2+vr"^523 -vr"^+"'5i3+7r"355i3+7r'^3-a2y^^2 
(% - 5)522 = (7r-'^^5i2 - 7r-"^523 + 513) x(7r«i+«2 - Tr^^y). 

Then setting 

5ii = 511 +7r"'5i2 + 7r''3x5i3 5^3 = 5i2 + 7r"25i3 

522 = 522 -vr'''5i2 +vr"2 523 - 7r"i+'^2(,^3 = 
533 = 533 - 7r"2 523 + 7r"i+"2 5i3 -7r"3 55i3 5^3 = 523 - 7r"i5i3 

gives elements 5 = [gij] and 5' = [g'^j] of B with 

On the other hand, given x, y G 01^ we see that if 5 = [gij] and 5' = [5'^] are 
elements of B with gtg^^x = t&,y9' then (1-3) hold. Hence ia,a; and ia.y represent 
the same double coset precisely when such solutions exist. 

First suppose that ai + 02 / 03. If ta,rr and ta,?; represent the same double 
coset for distinct x,5 G then from (3) we see that 

(4) val(a; — y) > min{ai, 02, 03 — 04, 0,3 — 02}. 

Conversely, suppose that we have distinct ,t, y G "R^ so that (4) holds. If 
the minimum occurs for ai then 03—02 > ai, since 01 + 02 / 03, and we 
have val(7r"i+"2 _ -/r^sy) = a\ + a-2- Setting 523 and 513 both to be zero and 
choosing 512 with val(5i2) = val(x — 5) = oi will give 522 G 31^ by (3). Further, 
511)533 € by (1) and (2) since 03 — 02 > 1. If the minimum occurs for 
03 — oi then 03 — oi < 02 and val(7r"i'*'"2 — iT"'^y) = 03. Taking 512 and 513 to 
be zero and 523 such that val(523) = val(x — y) — (03 — oi) gives 522 G Ji^ and, 
provided that we make the specific choice 523 = y — x when 03 = oi, we will 
also have 511,533 G "31^ . The arguments when the minimum is 02 or 03 — 02 
are similar and so we obtain a solution of (1-3) in each case. Hence for every 
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a G T°° with ai + 02 7^ as we may take a representative ta,a; with x lying in the 
set 

rj^^rpmin{ai,a2,a3— 01,03—02} 

and distinct elements of this set give distinct double cosets. 

Now suppose that ai + 02 = as and that ia,a; and t^^y represent the same 
double coset for distinct elements x,y e If val(l — x) > val(l — y) then 
val(a; — y) = val((l — y) — (1 — x)) = val(l — y) and if val(l — x) < val(l — y) 
then val(x — y) = val(l — x) < val(l — y). However, from (3) we know that 
val(a; — y) > minjai, 02} + val(l — y) > val(l — y). Therefore, we must have 

(5) val(l — x) = val(l — y) = i and val(x — y) > min{ai, 02} + i- 

Conversely, let x,y € 01^ be such that condition (5) holds. If ai < 02 then 
choosing 323 = 513 = and 512 with val(3i2) = val{x — y) — ai — i gives 322 G 
and (711, 533 G 31^ since 03 — 02 = oi > 0. If 02 < ai there is a similar argument 
and we again have a solution of (1-3) in each case. Hence for every a G T°° 
with ai + 02 = as we may take a representative ta,a; with a; from the set 

00 

= (J(l +7r*D?^) n (0?/ymWai,a2}+i-)X 

i=0 

and distinct elements of this set give distinct double cosets. □ 
Theorem 4.3. A complete set of (B, B)-double cosets in K is given by 



R= {ia,.,sr'^\4"''^\si4"%S2sr>^0 : aG T~,x G X%a,/3 G Z+} 

where 





1 
7r"i 1 


' 


1 


' ■^l — 




1 

_ TT^ 


1 



tt" 


" 



1 


) ^2 






1 

tt"' 




1 


" 

1 




(a) 
S1S2 






1 

vr" 1 


1 " 







' 


1 


1 




" 

1 




, Wo = 


' 

1 



1 



1 " 








Proof. We have shown that each double coset has a representative of the form 
wk for some w G W, k E Vw and that, in particular, when w = 1 we can take 
it to be ta,x with a G T°°, x G X^. li w ^ 1 then k has at most two non-zero 
entries below the diagonal and wc arc able to independently scale these by any 
element of Jl^ via left and right multiplication by T. This means that each 
representative can be chosen from the set R described above. 

Representatives associated to distinct Weyl group elements must give distinct 
double cosets by the Bruhat decomposition of GL(3, f). Further, by Proposi- 
tion 4.2 we know that distinct elements from R^ = {ta,x '■ a G T°°,x G X^} give 
distinct double cosets. Thus we need to show that different representatives from 
R with the same non-trivial Weyl group element give different double cosets. 
We will prove only the case when it; = si and remark that the remaining cases 
are analogous. 
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If s^"'^^ and s^" represent the same double coset for some a, a' , /3, /3' G Z_|_ 

then there must be elements g = [gij] and g' = [g'^j] of B with gsf'^^ = s^^ ^ g' . 
This implies that the following two equations hold: 

(6) TT^'^ii = 7r-533-7r"+'^'5i3-7r"+^'523 

(7) TT^ 522 = 7r'^533 - TT^^^ 523- 

However (6) implies that a = a' and (7) implies that /3 = (3' . Hence if the pairs 
(a,/?) and {a' ,13') are distinct then s^^'^^ and s^" ^ represent different double 
cosets. □ 

5. General double cosets 

We now turn our attention to the case of (Cc, Cd)-double cosets for c, d € T. 
In this situation it is possible for the image of Cc or Cd in GL(3, f) to be a proper 
parabolic subgroup and so different Weyl group elements could represent the 
same double coset. To eliminate these duplications we introduce the subset 
Wc^A of W defined as follows: 

(i) Wc,A = {l,Si,S2,SiS2,S2Si,'u;o} if c,d ^ (1,1,1); 

(ii) VFc,d = {1, si, t^o} if c = (c, 0, c) with c > and d >z (1, 1, 1), or vice versa; 

(iii) VFc,d = {1, S2-,wo\ if c = (0, c, c) with c > and d >z (1, 1, 1), or vice versa; 

(iv) Wc^A = {1, Wo} if c = (c, 0, c) or (0, c, c) and d = {d, 0, d) or (0, d, d); 

(v) Wc,A = {1} if c = (0, 0, 0) or d = (0, 0, 0). 

Since Wc^d forms a set of representatives for the corresponding double cosets 
in GL(3. f) this ensures that representatives associated to distinct elements of 
Wc^d will indeed yield distinct double cosets. We therefore need to identify a 
set of representatives associated to each w G Wc,d- As in the previous 
section, we begin by looking at the set rJ d of representatives corresponding to 
the trivial element of W. 

Definition 5.1. Define the set of triples 

= {(ai, 02, as) G : 1 < ai, 02 < 03} 

and for any c, d G T let 

(8) Tc,d = {a G : a :^ c, a :^ d and 03 < min{ai + C2, di + 02}} 
with the following exceptions: 

' {(1,1,1)} if c = (0,0,0) or d = (0,0,0); 

(9) Tc,d = { {(1, a,a) : a < min{c2, ^2}} if ci = di = and C2, 1^2 > 0; 

{(a, 1, a) : a < minjci, di}} if C2 = ^2 = and ci,di > 0. 

Here c = {ci,C2,c^) where Cj = maxjcj, 1} for each i. 

Lemma 5.2. Let c,d G T, then each ta,x € d "^«2/ be chosen with a G Tc,d- 
Moreover, if SL^h G Tc,d o,re distinct then ia,a; o,nd t-^^y represent distinct double 
cosets. 
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Proof. It is clear from Theorem 4.3 that ^ can be taken to be a subset of 
{ta,x : a G T^, X G IR^ }. One can show exphcitly that for any a G and x e 51^ 
the double coset Ccta^xCa contains tt,^y where b ^ a is defined by 

bi = mm{ai,Ci,di}, 

62 = min{a2, 02,^2}) 

63 = min{a3,C3,(i3,oi +C2,di + 02}. 

Thus, all double coset representatives in rJ ^ may be chosen with a in the set 
defined by (8). When ci = cii = we can replace di +02 by 02 in the definition 
of 63 and, similarly, when C2 = (^2 = we can replace ai + £2 by ai . In these 
exceptional cases we may therefore choose a from one of the sets given in (9). 

We wish to show that distinct triples a and b from T^d yield distinct double 
cosets so suppose that g = [gij] G Cc and g' = [g'-j] G C^. are such that gtg^^x = 

h^yg' for some x,y G 3?^. Write 321 = 72i7r''S ^21 = l2i'^'^\ 532 = 7327^"'^, 
932 = 732^'^^ 531 = 73i7r''3 and g'^^ = Tsi^r'^'' where Jij^jlj G 01. Comparing 
the lower triangular elements in the above product gives the following three 
equalities: 

(10) 72ivr"' + 522vr''^ + 523aJ7r«3 = ff'nvr*^ + 72i7r'^' 

(11) 7327r^^+5337r'^^ = <?l22/vr'' + 522vr'^ + 732vr''^ 

(12) ^3i;r^3+^32^c2+ai+^^^^^a3 ^ ^iiy^r^^ + 72i7r''^+'' + 73i7r''^ 

We will assume first that ci and di are not both zero and that C2 and ^2 are 
not both zero. In this case we see that val(72;^7r'^i+''2) > + ^2, since if di = 
then ci > forces val(72]^) > by (10), and similarly val(7327r'^2+"^) > C2 + oi. 

If either of 03 or 63 is strictly less than min{c3, ^3, ai + C2, + 02} then (12) 
implies that = 63. However, 03 and 63 cannot be greater than this minimum, 
since a, b G Tc,d, so the only other possibility is that they are both equal to it. 
Further, if either ai or bi is less than min{ci, d]^, 03} then (10) gives ai = bi, 
but again the only other option is for them both to be equal to this minimum. 
Similarly, (11) shows that 02 = 62 and so we have a = b. 

Now assume that ci = di = and note that this means that we may have 72^ 
of valuation 0. In this case our triples a and b are such that 02 = 03 and 62 = ^3 
with oi = 61 = 1. If either of 02 or 62 is less than min{c2, ^2} then (11) implies 
that 02 = 62- Indeed, 02 and 62 cannot be greater than uim{c2,d2} so we see 
that a = b. A similar argument deals with the case when C2 = (^2 = 0. □ 

Definition 5.3. For a G Tc,d let 

a(c, d) = min'{ai,a2,a3 - 01,03 - a2,Ci - ai,di - Oj, ai + C2 - 03, di + 02 - 03} 
and 

a(c, d)' = min'{d3 — 03,03 — 03,01 — 01,^2 — 02} > a(c,d) 
where min ' means that we take if any of the terms is negative. 

Lemma 5.4. Let c,d G T, then 
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where 



Proof. Let gij, g'-, and ^'-j be as in the proof of Lemma 5.2, then (/ta,x = 
t&,y9' for some x,y G 51^ precisely when the following three equations can be 
solved for gn, 322 and 333 in 0?^: 

(13) 511 = ff22-<7i27r"^-5i3X7r«3 + 72ivr^^-"^-72ivr'''""^ + ff23a;7r"3""^ 

(14) 533 = ff22-5i2rj;7r-'^^-ffi3rj, + (/23vr"^-7327r'=^-"' + 732^'^'~"' 

{x - y)g22 = (5l2Vr""=' - 9231^-"^ + 9l3)xry + 721^77^=1-"! _ ^g^TT^S-as 

(15) - 7^2^7r'^'~"' + 7317^*""' - 732rx7r^'~"'~"' + 72irj;Vr'^i~"'~"' 

where for each z & 01^ we define = 7r"i+"2 _ ^7,-"^. 

Suppose first that ai + 02 7^ 03, then (15) immediately yields 

val(x — y) > a(c, d). 

Conversely, given distinct elements x,y € Ji^ with val(x — y) > a(c, d) then 
one can solve (15) for 5122 £ and a careful consideration of (13) and (14) 
reveals that one can choose these variables so that gu and 533 are invertible as 
well. Thus the set 

x^_^ = (3i/y^(<='<i))x 

exactly parametrises the representatives t^^x for a G Ted with 01 + 02 7^ 03. 

Now suppose that ai + 02 = 03. Let val(l — x) = i and val(l — y) = j, then 
from (15) we see that 

val(x — y)> min{ai + j, 02 + j, C2 - 02 + i, di - oi + j, a(c, d)'}. 

This clearly holds whenever i,j > a(c,d)' since val(x — y) > min{i,j} so we 
will assume that at least one of i or j is less than a(c,d)'. li i < j with 
i < a(c,d)' then val(a; — y) = i and we must have C2 = a2- However, when 
C2 = a2 we see that (15) gives val((x — y)g22 + 732(1 — x)) > i which implies 
that val((/22 — 732) > 0, since if val((/22 — 732) = then we would have 

val((x - y)522 + 732(1 - x)) = val((l - y)5r22 - (1 - a:)(fi'22 - 732)) = i- 

This in turn means that val((733) = val(5r22 —732) > by (14) and so (733 cannot 
be invertible. Similarly, if j < i with j < a(c,d)' then di = ai and g22 is not 
invertible by (13). Consequently, we must either have 

(16) val(l - x), val(l - y) > a(c,d)' 
or 

. . val(l — x) = val(l — y) = i < a(c, d)' and 

^ ^ val(x — y) > min{a(c, d) + i, a(c, d)'}. 
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Conversely, if re, y G 01^ are distinct elements satisfying (16) or (17) then it is 
possible to find solutions to (13-15). Hence, the set 

a(c,d)' 

(J (1 + 7r'3l^) n {'Ji/?<^'''^+Y n 

precisely parametrises the representatives ta,x for a € Tc.d with 01+02 = 03. □ 

Note that if 01 + 02 = 03 then the set X^^ lies between (3i/T^('^''^))^ and 

(3i/J'^(''''^)')^. In particular, when a(c,d)' = a(c,d) then the definition of X^^^i 
given in Lemma 5.4 reduces to the much simpler 

Further, in general we can compute directly that 

1 if oi + 02 7^ 03, a(c, d) = 

(q - l)g^(='<i)-l if 01 + 02 7^ 03, a(c, d) > 

a(c, d)' + 1 if oi + 02 = 03, a(c, d) = 

(a(c, d)' - a(c, d) + l){q - l)g<='<i)-i if 01+02= 03, a(c, d) > 0. 

Theorem 5.5. Let c,d G T, then a complete set of {Cc,Cd) -double coset rep- 
resentatives in K is 

Rc,d = [J R^d 

W&Vc,d 

where if w & Wc,d then we define R"^^ as follows 
(i) Ri_d = Ka;:aGTe,d,xGX^J; 

(ii) Rl]^ = {s[°''^^l<a<min{d2,C3},l</3<min{c2,(i3},-ci</3-Q<(ii}; 

(iii) R^^d = {s^"'^^l<a<min{di,C3},l</?<min{ci,(i3},-C2</3-a< ^2}; 

(iv) Rl]l^ = {sis^^^ : 1 < a < min{di,C2}}; 

(v) R^'l' = {S2S^^^ : 1 < a < min{ci, ^2}}; 
(vi) R^, = {wo} 
and otherwise we take R^,j = 0. 

Proof. We have already shown (i) in Lemma 5.4 so we need to consider the 
representatives corresponding to non-trivial Weyl group elements. As in Theo- 
rem 4.3 we will prove the case where w = si and note that the other cases are 
similar. ^ ^ 

Suppose that s^^'^'^ and s^" ■* represent the same double coset for pairs 
(a, (3) and (a', (3') with a,a',f3,f3' > 1. There must therefore be elements 

g = [gij] of Cc and g' = [g'^j] of Ca such that gs^^'^^ = s^" ^g' and, if we let 
7ij and 7^^- be as in the proof of Lemma 5.2, this occurs precisely when we can 
find gu , 522 , 533 e and 513 , 523 , 721 , 72i > 732 , 732 > 73i , 731 ^ ^ with 

(18) 7r"'5ii = 7r"533 - 7r"+"'5i3 - tt'^^'^' g23 - 7r^i+^'72i - 7r'^2732 + 7r^'73i 

(19) 7r^'522 = 7r^533 - 7r^+^'523 - 7r'^^+"'72i + 7r^^732 - 7r'^373i- 
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First note that we must have val(7r''^732) > ^2 since if ^2 = then (18) 
forces val(732) > 1 and, similarly, val{Tr'^'^js2) > C2 by (19). It follows that 
one can solve (18) and (19) whenever a' > min{a, ci + /3',c^2''^3} 1^' — 
min{/3, di + a', 02,^3}. Thus we may choose a representative with (a,/3) such 
that 1 < a < min{(i2) C3}, 1 < /? < min{c2, d^} and — ci < P — a < di. 

Now suppose that s^"'^"* and ^ are representatives for the same double 
coset where (a, /3) and (a',/3') satisfy the restrictions above. If either of a or 
a' is less than min{ci + P',d2,C3} then a = a' by (18). Further, if a and a' 
are greater than or equal to this minimum we actually have a > a' = Ci + P' 
with a = a' whenever f3 = /?'. Similarly, if at least one of /3 or /?' is less than 
minjdi + a', C2, lia} then /3 = /?' by (19) and otherwise (3 > (3' = di + a' with 
P = P' whenever a = a'. However, we cannot have both a' = ci + P' and 
P' = di + a' , since this would mean that ci = di = 0, so we must have a = a' 
and P = P' . Hence distinct pairs (a, P) give rise to distinct double cosets. □ 

Remark 5.6. The list of double coset representatives Rc,d given in Theorem 

5.5 does not seem to be symmetric in c and d. There is, however, a natural 
bijection from Cc\K/Cd to Ca\K/Cc obtained by sending each element of a 
double coset to its inverse. This does indeed induce a bijection from Rc,d to Rd,c 
since we see that 



{Ccs\ '^^Cd) 

(CcS2 '^''Cd) 

(CcSi4")Cd)- 

(CcS24"^C'd)-l 



CdS2st^C, 



where 



(b,y) 



(a,x-7r"3-"i-"2) ifai + a2<a3; 

((ai, 02, val(r^.)). Tx^^™'^''"'') if 01+02 = 03; 

((01,02,01 +02), -1 +X7r''l+"2-a3) if 01 + 02 >03. 



In particular. Theorem 5.5 is symmetric in c and d with respect to this bijection. 

We want to use the description of the double coset structure given Theo- 
rem 5.5 to investigate the components V^. Prom Corollary 3.4 we know that 



5(K,Fd)= (-1)" 



i+i^i 



'C/,dj I 



ICS^, JCSi 

and for each G I^ we will consider 



since then a(K, ^d) = E«,6W^ ^(K, Va) 



E (-i)'^'^'''ii^c„dj 

ICSc, JCSi 
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(0,C2,C2) 

c 



(0,C2 - 1,C2 
C{3} 



1) 



(C1,C2,C1 + C2) 

c 



(ci,C2,Cl + C2 
C{3} 



1) (Cl 



1,0, ci 

C{3} 



(ci,0,ci) 
c 




Figure 1 . The one descendant cases 

6. One descendant 

Rather than consider all possible c, we split the problem into three separate 
cases depending on the number of triples immediately below c in the poset T. 
Recall that the space of i^i-fixed vectors in V decomposes as 

y^' = %o,o) © %ij) © "^^(1,0,1) ® V{i,i,i) 

where (0, 1, 1) and (1, 0, 1) are the triples having exactly one descendant in T. 
The corresponding components V(o,i,i) ^(1,0,1) equivalent irreducibles 
and we find that single descendant triples (see Figure 1) will always give irre- 
ducible components which are equivalent to all other single descendant compo- 
nents lying in the same level. 

Theorem 6.1. Let c = (ci, C2, ci -|- C2) with ci + C2 > 1, then Vq is irreducible 
and 

dimFc = - l)(g + l){q^ +q+l). 

Moreover, Vc — ^ for any d = (di, c/2, di + ^2) with ci + C2 = di + d2- 

Proof. For ease of notation we will assume that c\ < d\. If we define c' = 0^3} 
and d' = d{3} then we want to calculate the alternating sum 

= |Rc,d| — |Rc',d| — |Rc,d'| + |Rc',d'|- 

First note that if ci, di, C2 and ^2 are all non-zero then R^^, R^, ^, R^^, and 
R^, ^, are all equal for any non-trivial Wcyl group clement w ^ W since we 
are only decreasing C3 or ^3 in Theorem 5.5 and these arc both greater than 
maxjci , di , C2 , ^2}- In the case where one or more of ci, di, C2 or 0^2 is zero the 
sets are equal in pairs since C3 = ^3 > 1. Consequently, we need only consider 

J(K,^d)^ = |Rj,d| — |Rc',dl ~ l^c.d'l + l^c',d'l- 

Now, from Definition 5.3 we see that Tc',d, Tc,d' and Tc',d' arc equal while Tc,d 
contains the additional triple a = {ci,d2,ci + C2) with a(c,d) = 0. If one of 
Cl, di, C2 or d2 is zero then a(c,d), a(c',d), a(c,d') and a(c',d') are all zero for 
every a G Tc',d'. On the other hand, if ci, di, C2 and d2 are all non-zero then 
the only way that a triple a € Tc'^d' could have a(c, d) strictly greater than any 
of a(c',d), a(c,d') or a(c', d') is if the minimum occurs for C3 — 03. However, 
C3 — 03 = Cl + C2 — 03 > ai + C2 — 03 so we would need ai = ci and the minimum 
would therefore have been 0. Thus again a(c,d), a(c',d), a(c,d') and a(c',d') 
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(ci,C2,max{ci,C2}) 
c 





(ci - l,C2,max{ci,C2}) 

C{1} 



(ci,C2 - l,max{ci,C2}) 

C{2} 





(ci - 1,C2 - 1, max{ci,C2}) 

^{1,2} 



Figure 2. The general two descendant case with ci, C2 > 1 
must be equal for every a G Tc',d'- This implies that rJ, ^j, rJ^, and rJ, ^j, are 



Taking c = d this shows Vq is irreducible and in general it implies that and 



In fact, the equivalences in Theorem 6.1 are the only ones that can involve 
a component Vc with a triple of the form c = (ci, C2, ci + C2). 

Proposition 6.2. Let c = (ci, C2, C1 + C2) with C1 + C2 > 1, then the multiplicity 
of Vc in Res^^^"* V is ci + C2 + 1. 

Proof. By Theorem 6.1 we may take c = (0, c, c) where c = Ci + C2. Further, 
since Kc is the largest principal congruence subgroup contained in C(o,c,c)j we 

know that every subrepresentation of Res^ V equivalent to Vc must be a 
subrepresentation of V^" ~ f^(c,c,c)- I'^ particular, this means that the multi- 

plicity of Vc in Res^ V is equal to its multiplicity in J7(c,c,c)- Thus, setting 
c' = C{3} = (0, c — 1, c — 1) and d = (c, c, c) we would like to calculate 




Vd must be equivalent. 



□ 



3{Vc,Ud) — |Rc,d| — |Rc',d 



Now, R^^ = R^,°^ = {wo} and R^^^ = R^, ,j = ij) for w = si, S1S2 or S2S1. However, 

for w = S2 we obtain R^^^j = R^?^ U {s2^'^''}. Further, for every a G Tc'^d we 
have a(c,d) = a(c',d) = and Tc,d = Tc'^d U {(l,a, c) : 1 < a < c}. Hence 
Rc,d = Rc',d U {t(i,a,c),i : 1 < a < c} U {4"'^^} and 



^{Vc, f/d) = (|Rc',d| + (c + 1)) - |Rc',d| = c + 1 



as required. 



□ 
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(1,C2,C2) (ci,l,Cl) 




(0,C2 - 1,C2 - 1) (Cl - l,0,Cl - 1) 

C{1,2} C{i,2} 



Figure 3. The extremal two descendant cases 

7. Two DESCENDANTS 

In the decomposition of V^^ the only component corresponding to a triple 

with exactly two descendants in T is V(i,i,i). This is the pull-back to K of the 
Steinberg representation of GL(3, f) so is irreducible and appears with multiplic- 
ity 1. Indeed, any triple c G T with two descendants (see Figure 2) will give an 
irreducible component Vc which has multiplicity 1 in the restriction of V to K. 
Here we note that if Cl = 1 then C{2} = (1, C2 — 1, C2) but C|i 2} = (0, C2 — 1, C2 — 1) 
so for the purposes of calculating !J(Vc,Vc) we ignore the triple in T that lies 
between them (see Figure 3). Similarly, we ignore the triple between c^iy and 
C{i 2} when C2 = 1. 

Theorem 7.1. Let c = (ci,C2,max{ci,C2}) where ci,C2 > 1 and ci + C2 > 1, 
then Vc is irreducible of dimension 

dimFc = g^i+^^+'^^i^i'^^l-s^^ _ ;l)2(^ ^ ^^^^2 + ^ + 1). 

Moreover, the multiplicity of Vc in Res^ V is 1. 

Proof. We will assume that ci < C2 so that c = (ci, 02,02) and remark that 
the proof for the case where ci > C2 is similar. Let d = (02,02,02), then as in 
Proposition 6.2 it suffices to calculate 

3{Vc,Ua) = |Rc0,(i| — |Rc{i},d| — |Rc{2},d| + I^C{i,2},d|- 

First suppose that ci > 1. We begin by examining the double cosets 
corresponding to non-trivial w € W. Let s^^'^^ be a representative which 
belongs to Rc0,d t)ut not to Rc^2}>d- Then /? = 02, since we are decreasing 
02, and 1 < OK < 02, since the restriction — oi < 02 — a < 02 does not 
play a role. Thus we see that R^J ,i = K\2-^,d ^ {si"'"^^ : 1 < a < 02} and 

^ci 1 d = ^c/ ^ {sj"''^^^ : 1 < a < C2} by the same argument. This means 

{I}) {1,2}5 
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that the contribution of these representatives to the alternating sum is 

Similarly, let S2°'^'* be a representative lying in R^^ ^ but not in d- 
now decreasing ci so /3 = ci and 1 < a < C2 since the restriction — C2 < ci — a < 
C2 IS agam irrelevant. We therefore obtain R^^ ^ = K\iy {^'^2''''^^ ■ I < a < 02} 
and Rc{2},d ~ ^c{i 2},d ^ {^2"'*^^^ : 1 < Q: < C2} in the same manner giving 

Further, it is easy to check that we also have J(Vc, U^)'^ = for it; = S1S2, S2S1 
and wq. Hence, we only need to consider 

= iRjfj.dl ~ |f''C{i},dl ~ |f''C{2},dl + I^C{i_2},dl- 

Now, Tc0,d = Tc^2},d U {(a>C2,C2) : 1 < a < ci} and for each a G Tc^2^,d the 
only way that we can have a(c0,d) > a(c{2})d) is if the minimum occurs for 
C2 — 02- However, since C2 — 02 =03 — 02 > 03 — 03, this would imply that 
03 = 02 and so we would in fact have a(c0,d) = a(c|2},d) = 0. Consequently 
a(c0,d) = a(c|2},d) for every a G T^^^yA and rJ^_<j = Rc^2},d ^ {*(a,c2,c2),i : 
1 < a < ci}. Similarly, ^c^^,d = Tc{i_2},d U {(0,02,02) : 1 < a < oi - 1} 
and a(c{i},d) = a(c{i_2},d) for every a G Tc^^2},d> implying that K[iy,d = 
^c{i,2},d U {t{a,c2,c2),i : 1 < a < 01 - 1}. Hence we obtain 

= (|Ri,,^,dl - (|Ri^, ,^,,| + (01 - 1)) - |Rj^^^,J + |Ri^^ ^^,,| = 1. 

and Vc is an irreducible subrepresentation of with multiplicity 1. 

Suppose now that oi = 1 so that c = (1, 02, 02) and 0{i 2} = (0, 02 — 1, 02 — 1). 

While we still have R^^^^ = Rc{2},d U {s^^'"'^ : 1 < a < 02} it transpires that 

^cji},d = 2},d = si^c^ ■^i belong to VFc{i},d or W^c{i,2},d- Thus in 

this case the contribution from these representatives becomes 

o{v,, u^r = {\K\,y,d\ + C2) - - |r:;^j,,| + = 02. 

In contrast, reducing ci no longer changes the inequalities in Theorem 5.5(iii) 

so Rc0,d = K\iy,d and K^^yA = Kl^^^yA^^^^''''^^} since in C{i_2} we also decrease 
the third entry. Consequently, 

3{v.,u,r = \K\,„d\ - K,„d\ - (\Kl,,,d\ + 1) + \Ki,,,d\ = -1- 

Further, Kl'J = K^^l^ U {sj,''^} and R^;;^,, = K^l^^^^ = giving 

u,r^^ = + 1) - - |R^,;^^^^,,| +0 = 1 

while 3(Vc, Ua)^ = ior w = S2S1 and wq. 

Now, Tc0,d = Tc^ij,d with a(c0,d) = a(c{i},d) = for ah a G Tc[^,d since 
we will always have Ci = Oi. Thus rJ^ and Rc^^j^ are equal. However, since 
in C{i 2} we also reduce the 03 entry, we have Tc^2},d = '^C{i2},d ^ {(1)02,02) : 
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(Cl - l,C2,Cl +C2 - k) 
C{1} 



(Cl, C2, Cl +C2 - k) 

c 



(ci,C2,ci + C2 - A; - 1) 

C{3} 



(C1,C2 - l,Cl +C2 - k) 
C{2} 





(Cl — 1,C2, Cl + C2 — fc — 1) (Cl — 1,C2 — 1, Cl + C2 — A;) (C1,C2 — l,Cl +C2 — — 1) 
C{1,3} ^^{1,2} '^{2,3} 



(Cl - 1, C2 - 1, Cl + C2 - fc - 1) 
"^{1,2,3} 



Figure 4. The three descendant case with 1 < A; < min{ci,C2} 



(C1,C2,C1 +C2 - 1) 

c 



(Cl - l,C2,Cl +C2 - 1) (C1,C2,C1 + C2 - 2) (ci , C2 - 1, Cl + C2 - 1) 

C{1} C{3} C{2} 



(Cl - 1, C2, Cl + C2 - 2) 
C{1,3} 



(Cl, C2 - 1, Cl + C2 - 2) 
C{2,3} 



(Cl - 1, C2 - 1, Cl + C2 - 2) 
C{1,2} = C{1,2,3} 



Figure 5. The three descendant case with k = 1 



1 < 02 < C2 - 1}. Again a(c{2},d) = a(c{i^2},d) = for every a G Tc^^ 2j,d so 
Rc^ij.d = Ri{i,2},d U {t(i,„2,c2),i : 1 < 02 < C2 - 1}. Thus 

C/d)' = |Rc{i},dl - |Rc{i},dl - (Ii^c{i,2},dl + - 1)) + |Rj^i,2},dl = -(^2 - 1). 

Hence, overall we obtain 

Ui) = -(C2 - 1) + C2 + (-1) + 1 + + 0=1 
and Vc is an irreducible subrepresentation of with multiplicity 1. □ 
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8. Three descendants 

The remaining case, where c has three triples immediately beneath it in T 
(see Figure 4) , does not appear in the decomposition of V^^ and we find that 
these components are reducible in general. Consider c = (ci, 02,03) as part of 
a chain of triples 

(ci,C2,ci + C2) h ■ ■ ■ h c y ■ ■ ■ y (ci,C2,max{ci,C2}). 

We let k denote the position of c in this chain, so that C3 = ci + C2 — k, and 
£ = minjci, C2} the length of the chain. The number of intertwining operators 
J(V^, Vc) turns out to be a polynomial in q whose degree is the minimum of k 
and i — k. Further, two triples correspond to equivalent components precisely 
when their chains start at the same level ci + C2, they have the same position 
k in their chain and that position is in the first half of the chain. Here we note 
that when k = 1 the triples Cj^ 3| and Cj^ 2,3} will be equal (see Figure 5) so 
their contributions will cancel in the alternating sum for Vc- 

Theorem 8.1. Let c = (ci, C2, ci + C2 — k) with < k < £ = min{ci, C2}, then 

q-2 ifk=l; 

((?-l)V-' ifl<k<li/2\; 

{q - if [i/2\ <k<£-l; 

(q-l) ifk = i-l. 

Moreover, let d = {di,d2,di + d2 — k') with < k' < £' = min{di,c/2}- If we 

have 

(i) C3 = d^,; 
(ii) k = k'; and 

(Hi) k < lmm{i,i'}/2\ 

then Vc Vd, otherwise J(Vc, 14) = 0. 

We will prove Theorem 8.1 in a series of steps. Let c and d be as above. When 
C3 7^ d^ it is clear that we will have J(Vc, Vd) = so we can assume that 03 = ^3. 
In particular, this means that di,d2 < C3 and ci , C2 < c/3 so if 7^ 1 then we 
have R^^^dj = ^c'/.dju^g} for each I, J C S = {1,2,3}. The contribution from 
the double cosets supported on non-trivial Weyl group elements is therefore 
and 

i,jcs 

Consequently, for a fixed triple a G Tc,d we will consider the alternating sum 

where we take [X^^ = for a ^ '^ci,dj- This gives J(Vc, Vd) = Z^aeic d ^a- 

We begin by showing that Vc and Vd will have no constituents in common if 
conditions (i-iii) in the Theorem are not met. 

Lemma 8.2. If k ^ k' , then 3a = for every a G Tc d- 
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Proof. Assume to the contrary that a is a triple in Tc,d with Ja / 0. We begin 
by showing that this cannot happen in the case where ai + 02 7^ 03. 

Suppose that 03 — 03 > a(c,d). For each I,J C S we see that a belongs 
to Tci,dj precisely when it belongs to Tc^^^^gj^dj. Moreover, if a G Tcj,dj then 
a(c7, dj) = a(c/y|3j, dj) since decreasing C3 by 1 does not change the minimum. 
However, this means that X^^ = ^tzu{3}Aj ^^'^ actually have 

:Ja = E E (-i)'^'"'''(k...i-k,.,3>,.j) = o- 

JC5 7C{1,2} 

Now suppose that C3 — 03 = a(c, d) but that ci — ai > a(c, d). When fc > 1 
the same approach can be used to show that 3a = so we need only consider the 
k = 1 case. Then C3 = ci + C2 — 1 gives 01 + 02 — 03 = (C3 — 03) — (ci — oi ) + 1 < 1 
implying that a(c, d) = oi + C2 — 03 = 0. In particular, a ^ Tc^^dj if 2 G / and 
a(c7,dj) = a(c7u{i},dj) otherwise. This again means that 

JCSIC{3} 

Similarly, Ja = if (i2— 02 > a(c, d) so the only triples a that could correspond 
to non-zero Ja are those with ci — ai = ^2 ^ ^2 = C3 — 03 = a(c, d). Note that 
in this case ai + C2 — 03 = and di + 02 — 03 = k' with ci < di and C2 > c/2 • 
If k < k' then we must have ci < di. Consequently, di — ai and di + 02 — 03 
are both greater than a(c,d) and we can show that Ja = since k' > 1. On 
the other hand, if A; > A;' then C2 > c/2 implies that C2 — 02 and oi + C2 — 03 are 
greater than a(c, d) and Ja = 0. Hence, when k ^ k' there cannot be a triple a 
with ai + 02 7^ 03 which has non-zero Ja- 

We now consider the case where 01+02 = 03 and note that a(c, d) reduces to 
the minimum of oi, 02, C2 — 02, di — oi and a(c, d)'. By an argument essentially 
identical to that given above we see that Ja can only be non-zero for triples a 
with ci — oi = £^2 — 02 = C3 — 03 = a(c,d)' and these have C2 — 02 = and 
c?i — oi = k'. If k < k' then di — ai > a(c, d) implying that Ja = whereas 
k > k' gives C2 — 02 > a(c, d) and again Ja = 0. Hence, we again see that when 
k ^ k' no triples a with ai + 02 = 03 have non-zero Ja- □ 

Lemma 8.3. If c d but k = k' , then 

{J(ci_fe,d2-fe,c3-fe) < di and k < [min{^, f }/2j ; 

3(^di-k,c2-k,di+c2-2k) ifci > di and k < [min{^,/}/2j ; 
otherwise. 

Proof. Assume that a G Tc,d has Ja 7^ 0. When oi + 02 / 03 the proof of 
Lemma 8.2 tells us that a = (ci— i, d2—i., d^—i) where i = a(c, d) and, moreover, 
that this can only happen if ci < di and C2 > ^2. If > a(c,d) then di — oi 
and di + 02 — 03 = k arc both greater than a(c, d) which implies that Ja = 0. 
Thus we must have i = k and k < min{oi, 02, 03 — 01,03 — 02} = min{£, £'} — k 
gives k < [min{^,^'}/2j. 
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Similarly, when ai + 02 = as we know that a = (di — A;, C2 — fc, di + C2 — 2k) 
where k = a(c, d) and that this only happens for ci > di and C2 < ^2- Further, 
k < min{oi,02} = mm{i,i'} — k again implies that k < [minj^, ^'}/2j . □ 

Lemma 8.4. For any c, 

nim{k,£—k} 
5(^)^)= '^{ci-i,C2-i,C3-i)- 

Proof. As in the previous Lemma, we know that only triples a G Tc,c of the form 
a = (ci — i, C2 — i,C3 — i) with i = a(c, c) can possibly contribute to J(Fc, Vc). 
However, in this case our only restrictions are that i < ai + C2 — = k 
and i < minjos — ai, 03 — 02} = £ — k so we need to include all such a with 
0<i<mm{k,£-k}. □ 



Lemma 8.5. Let c = d and i < mm{k,i — k}. For i ^ k we have 

J(ci-i,C2-i,C3-i) 

whereas if k < £ — k 



1 ifi = 0; 

q-2 ifi = l; 

[ (g-l)V-' ifi>l 



^ r g-3 ifk = l; 

J(ci-fe,c2-fe,c3-fe) \ (q- l){q - 2)q'=-2 ifkyi_ 

Proof. Let a = (ci — i, C2 — z, C3 — i) and note that oi + 02 = as if and only if 

i = k. 

First suppose that i ^ k and so ai + 02 7^ 03. If i = then a(c,c) = 
and a ^ '^ci,c,j for I,J C S not both empty. This therefore implies that 
Ja = |Xc,cl = 1- For i > we have a(c, c) = i and for I,JC.S not both empty 
a e Tcj,cj with a(c/, cj) = i — 1. Consequently, 

Ja = |Xt,J+ 5: (-l)l™|Xt„.J = |X?,J-|X?„cJ. 

other I, J 

When i = 1 we obtain "J^, = {q — 1) — 1 = q — 2 whereas for i > 1 this gives 

Ja = - l)q'-' -(q- l)q'-' = (q - ifq'-'- 

Now suppose that i = k and so oi + 02 = 03. Again we see that a(c, c) = i 
and a E '^ci,cj with a(c/, cj) = i — 1 for /, J C 5 not both empty. However, 
in this case a(c7, cj)' = i for / C {2} and J C {1} with a(c/, cj)' = i — 1 
otherwise. Thus 

other I, J 

Iy^ I Iy^ I 

When k = 1 this gives 3a = (<? — 1) — 2 = g — 3 and when A; > 1 we get 
J^={q- l)q''-^ - 2{q - l)q''~^ = - l){q - 2)q''-^. □ 
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Lemma 8.6. If ci < di and k = k' < [min{£, ^'}/2j, then 

_( q-2 ifk=l; 

■J{ci-k,d2-k,C3-k) I (g _ l)2gfc-2 ifk>l. 

Proof. Let a = (ci — k,d2 — k,c^ — k) and recall that 01 + 02 ^ a^. Then 
a(c,d) = k and a(c7,d/) = — 1 for /, J C 5 not both empty so the result 
follows by the argument for the first part of the previous Lemma. □ 

Proof of Theorem 8.1. By Lemmas 8.4 and 8.5 we see that \i k = 1 then 

3(Vc, Vc) = 3(ci,c2,c3) + ^{ci-i,c2-i,c3-i) = l + (g-3) = g- 2 
and similarly when 1 < k < i — k 

k 

3(^C)V^) = y ^ ■^(ci-i,C2-i,C3-i) 
i=0 

= 1 + (g - 2) + (g - ifq +... + {q- ifq^-^ + {q - l){q - 2)^-2 

= {q-l)V-'. 
However, if £ — k<k<i — 1 then 

e-k 

^(V'c, V^) = J(ci-j,c2-i,C3-i) 
i=0 

= l + {q-2) + {q- Ifq + ■ ■ ■ + {q - ifq^'^-^ + {q - 1)2^^-^-2 
= {q-l)q^-^-^. 
and when A; = ^ — 1, with £ > 2, 

= J(C1,C2,C3) + J(C1-1,C2-1,C3-1) = 1 + " 2) = ? - 1. 

Finally, if c and d have 03 = ^3, k = k' and A; < [min{£, ^'}/2j , then by the 
calculations above and Lemmas 8.4 and 8.6 

3{V,,V^) = 3{Vc,V^) = 3{Va,V^). 

Hence Vc and must be equivalent. □ 

It should be noted that in proving the reducibility of Vc, we have discovered 
a certain amount of information about its decomposition. Let i = for 
< i < min{A;,^ — k} and consider the representation V^ = C^c/ Sc-<d-<c-i 
where Ul = Ind^"^ 1. Clearly, Vc = Ind§^_. Vc and we may use the results of 
Section 3 to show that 



i,jcs 

However, the (Cc^, Ccj)-double coset representatives in Cc-i are precisely the 

c - i. Thus 



tax in Rr, r , which have a c — i. Thus 



a^c— i 
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where Ja is as before, and Lemmas 8.4 and 8.5 immediately imply the following. 
Proposition 8.7. Let < i < min{fc,^ — k}. For i ^ k we have 

V c ) c / (g — l)q^ ^ « > 1 

whereas if k < £ — k 

k T/fcx _ / (9 - 2) ifk = l; 



3{v:,v: 



{q-iyq"-^ ifk>l. 



In particular, this means that the irreducible constituents of Vc are induced 
from the irreducible constituents of ''^ _ 

9. Application to Steinberg representations 

In [5], Lees defined a virtual representation Sr of GL(n, Ili/J"') which pos- 
sessed properties that were similar to those of the Steinberg representation of 
GL(n, f). Further, he stated without proof that Sr was in fact a subrepresenta- 
tion of the permTitation representation over the subgroup of upper triangular 
matrices. Although this is the case for n = 2 and for n = 3 with r < 2, we will 
show that Sr is not a true representation for r > 2. 

When n = 3, and pulling back to K, the expression of Sr as an alternating 
sum of permutation representations reduces to 

r 

(20) [Sr]= 5^ (-l)^^+^^[C/(ci,c„ma.W,e,})]. 

Cl, (-2=0 

If r = then we obtain the trivial representation 5*0 = V(o,o,o) ^'^d r = 1 
produces Si = V(i^i i), the Steinberg representation of GL(3, f) pulled back to 
K. More generally, Sr can be constructed inductively in the following way. 

Lemma 9.1. Let r >2, then 

(21) [5.] = [5._2]+^(-l)'-'=HK] 

c 

where the sum runs over all triples c = (ci,C2,r) G T with ci = C2 (mod 2). 

Proof. This can easily be seen by comparing the coefficients of in (20) and 
(21) for each c ^ {r,r,r). □ 

In particular, Lemma 9.1 implies that 

[S2] = [^(2,2,2)] - [^(1,1,2)] + [^(0,2,2)] + [^(2,0,2)] + [^(0,0,0)]- 

Further, V(i^i^2)) ^(0,2,2) aiid ^(2,0,2) all equivalent so this is actually the sum 
of three irreducible representations S2 — ^(2,2,2) + ^(1.1,2) + ^(0,0,0) • However, 
when r > 2 we see that V(^r-i,r-'i,r) still appears with coefficient —1 in (21) 
and in this case V(^r-i,r-i,r) constituents in common with any other 

component Vc- Hence it cannot cancel with any other term in (21) and we 
have shown the following. 

Proposition 9.2. Sr is a true representation if and only if r <2. 
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